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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re application of: 


Examiner: Vang, Ryan R. 


HAEBERLl 


Art Unit: 2672 


Application No.: 09/721,437 




For: Previewing and Manipulating A 
framed Image Print 


APPELLANT'S REQUEST FOR 
REINSTATEMENT OF APPEAL AND 
SUPPLEMENTAL BRIEF ON APPEAL 



I hereby certify thot Aia cvrrcspondcnce Js being 
dflposited with the ITnited Siatqrs Poslal Service 
as first class mail in od envelope addressed) lo: 
Commissioner for Patents, F»0 Box 1450, 
Alexandria, VA 223 13 




Mail Stop Appeal Brief - Patents 
Commissioner for Patents 
RO. Box 1450 
Alexandria, VA 22313-1430 



Sir: 

This Brief is presented in support of a Request for Reinstatement of the Appeal filed 
herewith, from the rejection of Claims 1-27 of the above-identified application, as set forth in the 
Office Action mailed August 12, 2004, 

There is no fee for the Request for Reinstatement Please deduct any additional fees or 
credit any excess fees associated with the Appeal Brief to Deposit Account 501861. Appendix 
A, attached hereto, contains a copy of all claims pending in this case. 
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REAL PARTY OF TNTPI^PgT 

The Real Party of Interest is Shutterfly Inc., a Delaware corporation. 

RELATED A PPEALS AND INrTF.RFFRP.Krpg 

There are no related appeals or interferences for the above-referenced patent application. 



ilOOl 



STATUS OF Cr .ATMS 

Claims 1-27 are pending and are the subject of this Appeal. All claims have been 
rejected. Claims 1-27 are the subject of this appeal. No other claims are pending. 



STATUS OP AMENDMENTS 



The claims were amended in response to an Office Action mailed in February 2003. A 
Final Office Action was mailed on April 26, 2004. An Appeal Brief was filed May 27, 2004, 
and an Office Action mailed August 12, 2004 raised new grounds of rejection. 

A copy of all the pendhig claims, prior to the after final amendment, is provided in 
Appendix A attached hereto. 

SUMMARY OF THE INVENTTON 

In one aspect the invention provides a method of generating a frame prototype image 
showing a picture image framed within a frame. The method includes providing a frame image 
showing the frame in a perspective view, the frame image having a picture portion corresponding 
to the portion of the frame used to view a picture mounted in the frame; mapping the picture 
image to the picture portion of the frame image in order to generate the frame prototype image 
wherein the perspective frame image is not shown in a head-on view; and providing an enhanced 
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edit set along with the frame image, the enhanced edit set iiK;luding user manipulatable tools for 
editing either the picture or the frame in the perspective view. 

One or more of the following advantages may be provided. The systeins and metliods 
described herein provide a more realistic presentation of an image based product. The image 
based product can be an image in a frame. Other image based products such as photocards. 
greeting caids, t-shirts, mugs, and other novelty items can also be displayed using a perspective 
view that enhances the appeal of the product The user's perspective frame view can be 
enhanced by lighting and other effects and displayed in an environment to help simulate the 
appearance of the image-based product in various settings. The user can apply one or more 
enhancing features to the image while displayed in the environment. Effects can be applied to 
the image, producing a resultant image that can be provided in a perspective view in the 
environment. The framed image cau be manipulated to change its position, orienlation, or size. 
ISSUES PRESENTFD FOR REVIEW 

I. WHETHER CLAIMS 1 -9, 11 , 1 8 AND 26 ARE ANTICIPATED BY OLES 
(6,047,130) AND TEO (6,064,399) 

II. WHETHER CLAIM 1 0 IS PATENTABLE UNDER SECTION 1 03(A) OVER 
OLES, TEO AND KURASHIGE (5,282,262) 

in. WHETHER CLAIMS 12-17, 19-22 AND 24-25 ARE PATENTABLE UNDER 
SECTION 103(A) OVER OLES. TEO AND OBERG (5,870,771). 

IV. WHETHER CLAIM 23 IS PATENTABLE OVER OLES, TEO, OBERG AND 
FREEMAN (6,356,288). 

V. WHETHER CLAIM 27 IS PATENTABLE OVER OLES, TEO AND MORRIS 
(6,453.361). 

GROUPING OF CLAIMS 

For each ground of rejection that appellant contest herein, which applies to more than one 
claim, such additional claims, to the extent separately identified and argued below, do not stand 
or fall together. 
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ARGIJTVfFNT 

CLAIMS 1-9, 11.18 AND 26 ARE NOT ANTICIPATED BY OLES AND TEO 

Claims 1^9, 11, 18 and 26 were rejected under Section 102(b) as anticipated by Oles and 
further in view of Teo. Oles discloses a photographic camera synchronized to a video camera 
with a computer and viewing monitors that aUows professional photography customers to 
visually detemiine the appropriate size of aportmit photograph and matching picture frame by 
displaying upon a viewer a perspective view of a video image of the photographic fanage and the 
matching picture frame within a simulated room image. Teo discloses a method and system for 
constructing a panoramic image including the steps of applying panordmic curvature to at least 
one image, thereby to create a panoramic background embedding in the panoramic background 
an additional image having a geometry other than that of the panoramic curvMuits thereby to 
provide a composite panoramic image containing an embedded image corresponding to the 
additional image and whose geometry matches that of the panoramic background. 

Generally, the present rejection does not establish prima facie anticipation. A single 
cited art reference must teach each and ev ery element of the claim to establish anticipation under 
35 U.S.C. §102. MJ'.E.P. §2131; In re Royka, 180 U.S.P.Q. 580 (CCPA 1974) ("All words in a 
claim must be considered in judging the patentability of that claim against the prior art."). The 
Court of Appeals for the Federal Circuit has held that, "the identical invention must be shown in 
as complete detail as is contained in the .. claim." Richardson v. Suzuki Motor Co., 9 
U.S.P.Q.2d 1913, 1920 (Fed. Cir. 1989). In the instant case, the Jordan et al. patent fails to 
describe or suggest several specific limitations recited in the claims of the present invention. 

Per MPEP Section 706.02, for anticipation under 35 U.S.C. 102, the reference must teach 
every aspect of the clai med invention either cxoHcitlv or implifidly In Oles, all appearances 
used "size perspective" for video image. Column 2 line 1 of Oles states "The present invention 
overcomes these deficiencies by providing a method and apparatus that allows a customer to 
visually determine the appropriate 3i2e of a portrait photograph and matching picture frame by 
displaying upon a portrait display viewer a perspective view of a combined video image of the 
photograph and the matching frame within a simulated room image." Further, Column 5 line 3 1- 
-35: "The present invention as depicted in FIG. 5 allows the customer or operator to change the 
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perspective of the video image (and the size of the resulting portrait) as well as move and 

position the combined image within the simulated .x>om setting image." This is further supported 

by the fact that all Oles figures show a frontal view of the picture. The fact that lie monitor 

showing the simulated picture(s) is shown in a 3D perspective view iUrfher supports th« 

contention that the "perspective view" in Oles is not the perspective view as claimed. 

In sum, die "perspective" teitn in Oles relates to the "size of the resulting portrait" and 

includes the fiame image shown in a head-on view. In contrast, each of the independent claims 

recite wherein the fitune imapc is not shown i n a head-on view In one embodiment of the 

present invention, a discussion of the "perspective view" is provided on page 6 as follows: 

A "perspective frame image" is an image that shows an in-perspective view of a fraine 
fa other words, the frame in such a ncrspective frame i mage is not ■show.n in a head-oti vipw 
i-or example, a frame can be arranged in a typical scene in which the frame might be displayed 
(e.g., on a table) and then a digital camera can be used to capnire a perspective image of the 
frame as it appears in the scene. Also, a white piece of paper (or other suitable material) can be 
mounted m the frame where an image print would be displayed. As a result, the perspective 
frame image will include a white region located where an image print would be visible in the 
frame (also referred to here as the "picture area"). An example of such a perspective frame 
image 300 having a picture area 302 is shown in FIG 3A. 

As shown above, Oles cannot anticipate the invention as it only shows a head-on view. 
The Examiner notes that Teo taught the missing element. However, Teo fails to show each of 
the claimed element and cannot anticipate the claims. Withdrawal of the anticipation rejection is 
requested. 

Moreover, ARjlicants traverse the unpatentable rejection over Oles and Teo. Teo shows 
a method and system for embedding images and video segments within a panoramic image of a 
scene, so as to maintain the proper perspective. However, Teo deals with panoramic images of 
scenes used to provide a viewer with an immersive surround experience, as if the viewer was 
standing in the center of a scene gazing in several directions. Panoramic images can be produced 
by taking multiple snapshots of a scene, as a camera is rotated horizontally and possibly also 
vertically. The snapshots are joined together and projected onto an appropriate geometrical 
surface, such as a cylinder or sphere, to reproduce an omniview effect. Applying Teo to Oles 
would not result in an operable system as the projection of the picture image in Oles onto a 
cylinder or sphere would severely distort the image. Hence, the combination of Oles and Teo 
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would not be operable. Further, there is no motivation to combine the onmiviewing system of 

Teo to Oles, 



Additionally, Oles and Teo laU to show at least tb« claimed «pn>vidiiig su. enhanced 
edit set including user manipulable tools for editing either the picture or »he frame in the 
perspective view." Oles shows no such enhanced edit set. Oles' Fig. 3 description is 
reproduced below: 

FIG.3 illustrates the operator using the present invention to view the selected video image 
24 withm the selected picture frame image 26. The selected video image is initially 
transposed as a 5"x7" image on video portrait viewer 20 with the opemtor being able to 
raampulate or post-process the video image in a variety of ways including reducing or 
enlargmg the image, rotating the image, or repositioning the image on tiie video portrait 
viewer 20. The present invention includes previously stored images of picture frames 
available for viewing so that the operator can go through the picture frame images to find 
one suitable for the portrait. Essentially, the present invention incorporates a picture 
frame catalog within its storage system, with the further ability to combine the selected 
video image 24 with the selected picture frame image 26 to fonn a combined image as 
depicted in FIG. 3. The present invention allows a photographer to show the customer 
every existing style and color of picture frame available. The customer is then able to 
select from the many styles and types of picture frames that will best complement and 
display the portrait. All of tlie present invention's post processing capability is available 
for use on the combined picture frame image and video image. 

Oles describes item 22 as "Option menu 22 provides user access to all of the functions of 
the present invention such as reducing or enlarging the selected video image." However, 
nowhere in Oles does it show specifically the "providing an enlianced edit set mcluding user 
manipulable tools for editing either the picture or the frame" in the perspective view (wherein the 
frame imag e is not shown in a head-on view^ as discussed above. Here, Oles shows a 2D 
rendering of the picture or the frame from a frontal view. It does not show user manipulable 
tools for editing either the picture or the frame in the perspective view. 

Applicants respectfully traverse the Section 102 rejection. Per MPEP Section 706.02, for 
anticipation under 35 U.S.C. 102, the reference must teach every aspect of the claimed 
jnvcotion either explicitly or impliedlv. Here, Oles shows neither the perspective view nor the 
tools to edit the picture or the frame in the perspective view. 
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In sum, Oles and Tea cannot anticipate claim 1 since it fails at least one clflimcd element. 
Since a Sectic«i 102 rejection requires EACH and EVERY element to be present. Oles cannot 
anticipate any of the independent claims and thgs^ dependent liiereW Withdrawal of the 
Section 102 rejection on claims 1-9. 11. 18 and 26 is respectfully requested. 

i^JS™^^^^^ ^^^^^'>' ^^^-^ IS PATENTABLE OVER OLES TEO AND 
KURASHIGB. CLAIMS 12-17, 19-22 AND 24-25 ARE PATEOTABLE OVKl 
TEO AND OBERG, CLAIM 23 IS PATENTABLeXeR o£bS lio (^^^^^ 
FREEMAN, AND CLAIM 27 IS PATENTABLE OVER OLErXE^^D MO^ 

Claim 10 was rejected under Section 103(a) over Oles and Kurashige (5^82,262). 
Claims 12-17, 19-22 and 24-25 were rejected under Section 103(a) as unpatentable over Oles 
and Oberg (5,870,771). Claim 23 was rejected as unpatentable over Oles, Qberg and Freeman 
(6,356,288). Claim 27 was rejected as unpatentable over Oles and Morris (6,453^61). 

First, Appellant notes that references can not be arbitrarily combined. There must be 
some reason why one skilled in the art would be motivated to make the proposed combination of 
references. In re Nomiya, 184 U.S.P.Q. 607 (CCPA 1975). 

Additionally, these claims are allowable as they depend from allowable claim 1. Further, 
none of the references show the specifics of the dependent claims. To illustrate, as to claim 10, 
neither Oles, Teo nor Kurashige show displaying of the image and frame in the perepective view 
and the user raanipulable tools for editing either the picture or the frame in the perspective view. 
Kurashige relates to a hardware apparatus for transforming a two-dimensional input video signal 
onto a three-dimensional surface and for depicting illumination thereof by a spot light source 
liansforms the two-dimensional video signal in acconiance with a mapping data signal onto the 
three-dimensional surface. However, there is no specifics of displaying of the image and fiame 
in the perspective view and the user raanipulable tools for editing either the picture or the frame 
in the perspective view, and there is no suggestion of combining Kurashige with Oles. 
Withdrawal of the rejection of claim 10 is requested. 

To further illustrate, as to claims 12-17, 19-22 and 24-25, Oberg does not show providing 
a frame image showing the frame in a perspective view, the fiame image having a pichoie portion 
corresponding to the portion of the frame used to view a picture mounted in the frame. The 
frame molding 62 shown in Fia 3 is shown as a top view, indicating that it is NOT a perspective 
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view but a2D top view. Further, the superimposirion operation mentioned In Oberg is consistent 
with the 2D top view since in a 2D view, differing layer, only need to be super-imposed to 
provide a combined view. 

Moreover, Oberg Mis to show the "providing an enhanced edit set along with the frame 
image, the enhanced edit set including user manipulatable tools for editing either the picture or 
the frame in the perspective view." Here, Oberg's column 6, line 1-6 shows the image editing 
software and. as discussed above, Oberg does not show the perspective view. However. Oberg is 
absolutely devoid of the claimed specifics of an enhanced edit along with th^ fr«m^ Im.^ . 
the enhanced edit set including user manipulatable tools for editing either the picture or the 
frame in the perspective view. Oberg is completely silent on where the editing set is placed 
relative to the frame image. Oberg»s Fig. 3 shows only the fi^e and nothing else. Withdrawal 
of the rejection of claims 12-17, 19-22 and 24-25 is requested. 

Claim 27 was rejected under Section 103(a) as unpatentable over Oles, Teo and Morris 
(6,453,361). Moiris relates to an online system with a server for communicating with both client 
devices and photo-sharing web sites over a network. 

AppUcants respectfully traverse the rejection of claim 27. Here, neither Oles nor Morris 
shows instructions to provide a frame image showing the frame in a p erspetrtivp v,->^, the frame 
unage having a picnire portion corresponding to the portion of the frame used Lo view a picmre 
mounted in the frame; map the picture imape to th e picture p orti on of the frame image in order to 
generate the frame prototype image; and provide an enhanced edit set alont; with the frame 
image, the enhanced edit set including user manipulatable tools for editing either the picture or 
the frame in the pei:spective view. Hence, claim 27 is patentable over Oles and Morris for each 
of these reasons. 

Secondly, Applicants note tliai no motivation or suggestion, either in the cited art 
reference or in the knowledge generally available to one of ordinary skill in the art, has been 
cited by the Examiner to modify the Oles reference with Oberg so as to produce the claimed 
invention. Further, Applicants fail to identify any motivation to modify the reference teaching so 
as provide uploading of images that were edited and/or previewed in the perspective view 
arrangements as presently claimed. Applicants point out that the Examiner bears the initial 
burden of factually establishing and supporting any prima facie conclusion of obviousness. In re 
Rimhm. 189 U.S.P.Q. 143 (CCPA 1976); M.P.E.P. § 2142. If the Examiner does not produce a 
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prima facie case, the Applicant is under no obligation to submit evidence of nonobviousness. Id. 
In the instant case, the Examiner has not pointed to any evidence in Morris, or how knowledge of 
tliose skiUed in ihe art, provide a suggestion or motivation to modify the reference teaching so as 
to produce the claimed invention of claim 27. See In re Zurko, 59 U.S.P.Q.2d 1693 (Fed. Cir. 
2001) ([I]n a detennination of patentability .... the Board cannot simply reach conclusions based 
on its understanding or experience - or on its assessment of what would be basic knowledge or 
common sense. Rather, the Board must point to some concrete evidence in the xecord in support 
of these findings). 

Under Vaeck, absent any evidence of a cited suggestion or reasonable motivation in either 
Oles, Kurashige. Oberg or Morris reference, or knowledge of those skilled in the ait, to provide a 

""^Se showing tfie frame in a perspectivt^ vigw, the frame image having a picture portion 
corresponding to the portion of the frame used to view-a picture mounted in the frame; map tlie 
picture image to the picture ponj^p of thfl frftmr image in order to generate the frame prototype 

provide an enhanced edit set al ong with the frame ima p^ the enhanced edit set 
including user manipulatable tools for editing either the picture or the fhirae in the nersn^^.Tive 
view, and to upload the resulting image to a server, prima facie obviousness of the claims has not 
been established. As such, it is respectfully requested that the § 103(a) rejection of claim 27 and 
all claims be withdrawn. 

CONCLUSION 

AppeUant believes that the above discussion is fiilly responsive to al 1 grounds of 
rejections set forth in the Final Office Action. 

Please charge any required small entity fees to Deposit Account 501861. 



Respectfully submitted, 

Bao Tran 
Reg. 37,955 
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APPENDIX A 
COMPLETE SET OF PENDING CLAIMS 

1 . A method of generating a frame prototype image showing a picture image framed within 
a frame, Ae method comprising; 

providing a frame image showing the frame in a perspective view, the frame image 
5 having a picture portion corresponding to the portion of the frame used to view a picture 
mounted in the frame; 

mapping the picture image to the picture portion of the frame image in order to 
generate the frame prototype image wherein the perspective frame image is not shown in a 
head-on view; and 

10 providing an enhanced edit set along with the frame imagej the enhanced edit set 

including user manipulatable tools for editing either the picture or the fi^e in the 
perspective view. 

2. The method of claim 1, further comprising identifying a picture portion of the frame 
15 image. 

3. The method of claim 2, wherein identifying the picture portion of flie frame image 
includes providing a mat identifying the picture portion of the fl^e image. 

20 4. The method of claim 3, wherein the mat includes apluralily of pixels, each pixel 
having a pixel value. 

5. The method of claim 4, wherein identifying the picture portion of the fimme image 
includes setting each pixel in the mat that corresponds to the picture portion of the frame 

25 image to a first pixel value. 

6. The method of claim 2, wherein identifying the picture portion of the frame image 
includes identifying the outer perimeter of the picture portion of the frame image. 
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7, The method of claim 1 , wherein the picture portion of the frame image has a 
quadrilateral shape and the method further includes identifying the picture portion of the 
ftame image including identifying the four comers of the picture portion. 



5 8, 



The method of claim 1, further comprising displaying the frame prototype image. 
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9. The metliod of claim 1, wherein mapping the picture image to the picture portion of 
the frame image includes texture mapping the picture image to the picture portion of the 
frame image. 

10. The method of claim 1, wherein the mapping the picture image to the picture portion 
of the frame image includes mapping the picture image to the picture portion of the fimne 
image using the illumination of the picture portion of the frame image. 

15 11. The method of claim 1 , wherein the frame image is captured using a digital camera. 

12. The method of claim 1 wherein the enhanced image set includes a croppmg tool and 
the method includes 

cropping the picture in accordance with xiser instructions; and 
20 presenting the cropped picture in the picture portion of the fi^ame image. 

13. The method of claim 1, wherein the enhanced image set includes a border tool and the 
method includes 

adjusting the border of the picture in accordance with user instructions; and 
25 presenting the picture including new border m tlie picture portion of the frame image. 

14- The method of claim 1 , wherein the enhanced image set includes an effects tool and 
the method includes 

applying an effect to the picture in accordance with user instructions; and 
30 presenting the picture including selected effect m the picture portion of the frame image. 
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15. The method of claim 14, further comprising selecting the effect from the group 
consisting of black & white, soft focus, color tone and saturate. 

16. The method of claim 14, wherein the effect applied is color tone and the method 
5 further comprises 

receiving color tone adjustment data and presenting a color tone adjusted picture Ln the 
picture portion of the frame. 

17. The method of claim 1, wherein the enhanced image set includes a rotation tool and 
10 the method includes 

rotating the frame in accordance with user instructions; and 
presenting the rotated framed in the framed image: 

1 8. The method of claim 1, wherein the enhanced image set includes a rotation tool and 
the method includes 

1 5 rotating the picture image in the frame in accordance with user instructions; and 
presenting the rotated picture image in the frame of the fi-amed image. 

19- The method of claim 1, wherein the enhanced image set includes a border tool and the 
method includes 
20 receiving a border width selection; 

adjusting the border width of the picture image in accordance with the border width 
selection; and 

presenting the picture image including adjusted border in the framed image. 

25 20. The method of claim 1 , wherein the enhanced image set includes a frame adjustment 
button and the method includes 
receiving a frame size selection; 

changing a size of the frame in the perspective view in accordance with the frame size 
selection; 

30 mapping the picture image to a picture portion of the new si^e frame; and 
presenting the picture image in the framed image, 

12 
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21 . The method of claitn 1 , wherein the enhanced image set includes a trimming tool and 
the method includes 

trimming the picture image in accordance with user instructions; and 
presenting the trimmed picture image in the frame of the framed image. 

5 

22. The method of claim 1 , wherein the enhanced Image set includes a deh'ght me tool 
and the method include$ 

activating the delight me tool upon user request; 
automatically selecting a feature or effect to apply to the framed image; 
1 0 applying the selected feature to the framed image; and 
presenting the framed image, 

23 . The method of claim 22, wherein the step of automatically selecting a feature 
includes randomly selecting a feature. 

15 

24. The method of claim 22, wherein the step of automatically selecting a feature or 
effect includes selecting a feature or effect to apply to the picture image. 

25. The method of claim 22, wherein the step of automatically selecting a feature or 
20 effect includes selecting a feature or effect to apply to the frame. 

26. A computer program pnsduct tangibly embodied in a computer-readable medium, for 
generatmg a frame prototype image showing a picture image framed within a frame, 
comprising instructions operable to cause a computer to: 

25 receive the picture image; 

store a frame image showing the frame in a perspective view and a mat identifying the 
picture portion of the frame image; 

map the picture image to the picture portion of the frame image in order to generate the 
frame prototype image wherein the frame image is not shown in a head-on view; and 
30 provide an enhanced edit set along with the frame prototype image, the enhanced edit set 
including user manipulatable tools for editing either tlie picture or the frame in the 
perspective view. 

13 
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27. A system for generating a frame prototype iTnage showing » picture image framed 
witliin a frame, the system comprising; 
a client computer in communication with a computer network; 
5 ^ server, in communication with a computer network, having server software embodied iii a 
computer-readable medium, the server software comprising instructions operable to cause the 
server to: 

receive the picture image from the client computer; 

Stone a frame image showing the frame in a perspective view and a mat identifying the 

1 0 picture pordou of the frame image; 

map the picture image to the picture portion of the frame image in order to generate the 
frame prototype image wherein the frame image is not shown in a head^n view; and 
present an enhanced edit set along with thc fr-ame prototype image, the enhanced edit set 
including user manipulatable tools for editing either the picture or the frame in the 

1 5 perspective view; and 

wherein the client computer includes client software embodied in a compulcr-rradable 
medium, the client software comprising instructions operable to cause the client computer to 
upload the picture image to the server. 
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